Blog

Kawamura Yuto

He is an engineer working at LINE. He is in charge of developing and managing LINE's core data pipeline and storage which are built on top of some OSS technologies such as Apache Kafka

Adding experimental WebAssembly support to Decaton - Part 2
Kawamura Yuto2020-09-17
He is an engineer working at LINE. He is in charge of developing and managing LINE's core data pipeline and storage which are built on top of some OSS technologies such as Apache Kafka
In the 1st part of this article, we looked into how we can integrate WebAssembly runtime into a Java application. Then we faced a big limitation of current Wasm/WASI that it doesn't support sockets, making most of the practical Decaton processors difficult to be hosted on it due to disabled network I/O. In this 2nd part, we will attempt to extend WASI APIs and Rust's standard library to add support for sockets. The goal is to make the below Decaton Wasm processor working (the processor implemen
Adding experimental WebAssembly support to Decaton - Part 1
Kawamura Yuto2020-09-17
He is an engineer working at LINE. He is in charge of developing and managing LINE's core data pipeline and storage which are built on top of some OSS technologies such as Apache Kafka
WebAssembly is a binary instruction format for a stack-based virtual machine, which aims to be a compilation target of many programming languages to enable executing a program at any place like browsers, embedded devices, and servers with high portability, high performance, and sandboxing capability. Wasm recently caught my interest along with the Rust programming language, and I came up with an idea to integrate it with Decaton, a Kafka consumer framework that we develop and ma
Applying Kafka Streams for internal message delivery pipeline
Kawamura Yuto2016-08-18
He is an engineer working at LINE. He is in charge of developing and managing LINE's core data pipeline and storage which are built on top of some OSS technologies such as Apache Kafka
IntroductionHello, my name is Yuto Kawamura. I'm a LINE server engineer in charge of developing and operating LINE's core storage facilities such as HBase and Kafka.Since the latter half of last year, I've been working on a new project called IMF, which stands for Internal Message Flow (or Fund). IMF has two main goals:Develop a data pipeline which provides a unified way of delivering events between our systems.Replace talk-dispatcher, a component in the LINE server system responsible for backgr
- Kafka

Kawamura Yuto

Adding experimental WebAssembly support to Decaton - Part 2

Adding experimental WebAssembly support to Decaton - Part 1

Applying Kafka Streams for internal message delivery pipeline